Incremental Effects of Mismatch during Picture-Sentence Integration: Evidence from Eye-tracking
نویسندگان
چکیده
A model of sentence-picture integration developed by Carpenter and Just (1975) predicts that picturesentence integration ease/difficulty depends on picturesentence match/mismatch respectively. Recent findings by Underwood, Jebbet, and Roberts (2004), however, fail to find a match/mismatch difference for serial picture-sentence presentation in a sentence verification study. In a sentence comprehension study with serial picture-sentence presentation we find no match/mismatch effect in total sentence inspection times. However, inspection times for individual sentence regions reveal a mismatch effect at the very sentence constituent for which the corresponding picture constituent mismatches, and this in a study with a sentence comprehension rather than verification task. Drawing on insights about spoken sentence comprehension during the inspection of concurrent scenes, we suggest that the absence of a mismatch effect in the Underwood et al. studies might be due to grain size of gaze time analyses.
منابع مشابه
Incrementality in Planning of Speech During Speaking and Reading Aloud: Evidence from Eye-Tracking
Speaking is an incremental process where planning and articulation interleave. While incrementality has been studied in reading and online speech production separately, it has not been directly compared within one investigation. This study set out to compare the extent of planning incrementality in online sentence formulation versus reading aloud and how discourse context may constrain the plan...
متن کاملEffects of Speaker Emotional Facial Expression and Listener Age on Incremental Sentence Processing
We report two visual-world eye-tracking experiments that investigated how and with which time course emotional information from a speaker's face affects younger (N = 32, Mean age = 23) and older (N = 32, Mean age = 64) listeners' visual attention and language comprehension as they processed emotional sentences in a visual context. The age manipulation tested predictions by socio-emotional sel...
متن کاملDifferent mechanisms for role relations versus verb-action congruence effects: evidence from ERPs in picture-sentence verification.
Extant accounts of visually situated language processing do make general predictions about visual context effects on incremental sentence comprehension; these, however, are not sufficiently detailed to accommodate potentially different visual context effects (such as a scene-sentence mismatch based on actions versus thematic role relations, e.g., (Altmann & Kamide, 2007; Knoeferle & Crocker, 20...
متن کاملIs incremental semantic interpretation related to end-of-sentence verification?: Evidence from correlation analyses
Prior research has typically viewed verification as a “late” process that is distinct from comprehension, occurring only after sentence comprehension is complete (e.g., Tanenhaus et al., 1976). If so, we would expect to see no clear relationship between incremental semantic interpretation processes and endof-sentence verification times. Alternatively, these two processes may be systematically r...
متن کاملEmotional Priming of Sentence Comprehension: Effects of a Speaker's Static Emotional Expression and Listener Age
We report two visual-world eye-tracking experiments that investigated how and with which time course emotional information from a speaker’s face affects younger (N = 32, Mean age = 23) and older (N = 32, Mean age = 64) listeners’ visual attention and language comprehension as they processed emotional sentences in a visual context. The age manipulation was aimed at testing predictions by socioem...
متن کامل